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(54) IMAGE PROCESSING METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To make selectable only the 
necessary areas as the correcting object areas by 
segmenting en bloc color defective areas such as pink- 
eye areas including a catch light part and correcting 
these segmented areas. 

SOLUTION: The image of a pink eye including is 
peripheral area is designated as a processing object area 
among those images displayed on a monitor (S100). The 
feature value of the processing object area that is 
designated by one of six designation modes is calculated 
(S102). The designated image is divided for every area 
where the feature value forms a mountain (S104). The 
shape, layout relation (position) among those divided 
image areas, area ratio, density and mean color tone are 
checked in each divided area, and the area having the 
most outstanding feature of a pupil part is selected as a 
pink-eye area (S106). All pixels of the pink-eye area are 
corrected like the lightness of the pixel having the 
lowest lightness based on this pixel (S108). A high 
luminance area, i.e., a highlight area is formed in the corrected pink-eye area as a catch light 
(S1 10). 
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* NOTICES * 

'Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 . This document has been translated by computer.So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The picture field including the eye field which became poor [ a color tone ] specified 
beforehand is made into xy flat surface. Picture characteristic quantity is calculated for every 
pixel with any one or two combination or more in a hue, saturation, and lightness. Set up the 3- 
dimensional xyz space which arranges this characteristic quantity to the z-axis, and field division 
of the xy flat surface is carried out for every field in which the value of the z-axis has a 
mountain-like distribution configuration to the breadth of xy flat surface. With any one or two 
combination or more in the configuration information on xy flat surface of each division field, 
positional information, area information, and statistical picture characteristic quantity The image- 
processing method which corrects the field which distinguished the color tone poor field of a 
pupil and was distinguished from the color tone poor field so that it may become the picture of a 
normal eye visually. 

[Claim 2] the time of carrying out field division of the xy flat surface for every field with the 
distribution configuration of the shape of an aforementioned mountain — the account of befor - 

- for every pixel in the picture field specified beforehand in the reference field for a N line xM 
train (1 or more [ However, N and M ]) pixel centering on the view pixel of a number allotment 
processing object When the value of the aforementioned characteristic quantity of a view pixel is 
the maximum, a new number is assigned for this view pixel as a crest point. When the pixel which 
the value of the aforementioned characteristic quantity of a view pixel is not the maximum, and 
has the value of the maximum characteristic quantity other than the view pixel in the 
aforementioned reference field assigns and it has a number It repeats until one of crest point 
numbers is given about all the pixels in the picture field specified beforehand, the number 
allotment processing which gives this allotment number to a view pixel — the account of before 

— The image-processing method according to claim 1 of performing picture field division by 
making a set of a pixel with the same number into one field. 

[Claim 3] The pixel of a law is made into a view pixel, the time of carrying out field division of the 
xy flat surface for every field with the distribution configuration of the shape of an 
aforementioned mountain — the account of before — in each pixel in the picture field specified 
beforehand, a number is undecided — When the pixel which has the value of the aforementioned 
larger characteristic quantity than a view pixel is in the reference field for a N line xM train (1 or 
more [ However, N and M ]) pixel centering on this view pixel, Memorize the position of a view 
pixel and the processing whose value of the aforementioned characteristic quantity makes a 
large pixel the point paying [ new ] its attention is repeated. If the number of the aforementioned 
point paying [ new ] its attention is undecided when the value of the characteristic quantity of 
the aforementioned point paying [ new ] its attention is the maximum in a reference field, a new 
number will be assigned for this point paying [ new ] its attention as a crest point. The number 
allotment processing which will give the number to all the pixels of the coordinate which carried 
out [ aforementioned ] storage if the number is already assigned to the aforementioned point 
paying [ new ] its attention the account of before — the image-processing method according to 
claim 1 or 2 of performing picture field division by making as t of a pixel with the same number 
into one field repeatedly until one of crest point numbers is given about all the pixels in the 
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picture field specified beforehand 
^ [Claim 4] The 1st mark as configuration information which serves as size in distinction of the 

' color tone poor field of the aforementioned pupil using circularity characteristic quantity for 
every division field, so that it is more nearly circularly near, The 2nd mark as positional 
information which serves as size, so that the center of gravity of a division field is close to the 
center position of the appointed field, The 3rd mark as area information which serves as 
smallness, so that the ratio of the area of a division field and the area of the appointed field 
separates from the predetermined range, The average or more in any one of a hue, saturation, 
and lightness, maximum, Any one or more of the minimum value, contrast, and histogram 
configurations are used. The 4th mark as statistical picture characteristic quantity which shows 
a color tone poor degree from comparison with statistical color tone poor field information, And it 
asks according to the center position of a pupil specified beforehand, and the interval of both 
eyes. The image-processing method given in any 1 term of a claim 1 to the claim 3 which 
calculates at least one of five mark of 5th mark ** as positional information used as smallness, 
so that it separates from the center of a pupil, and judges what has the highest mark to be a 
color tone poor field. 

[Claim 5] The image-processing method according to claim 4 of judging the field of a high order L 
(however, L one or more integers) individual by any two or more aforementioned averages of 
mark or weighted average mark to be a color tone poor field. 

[Claim 6] The picture field including the eye field which became poor [ a color tone ] specified 
beforehand is made into xy flat surface. Picture characteristic quantity is calculated for every 
pixel with any one or two combination or more in a hue, saturation, and lightness. Set up the 3- 
dimensional xyz space which arranges this characteristic quantity to the z-axis, and field division 
of the xy flat surface is carried out for every field in which the value of the z-axis has a 
mountain-like distribution configuration to the breadth of xy flat surface. With any one or two 
combination or more in the configuration information on xy flat surface of each division field, 
positional information, area information, and statistical picture characteristic quantity The 
correction including the processing to which gradation is applied so that it may apply to a cent r 
section from the periphery of the color tone poor field of the pupil which distinguished the color 
tone poor field of a pupil and was distinguished from the color tone poor field and both lightness, 
and both [ any one or ] may fall gradually is made. The image-processing method which corrects 
the color tone poor field of the aforementioned pupil so that it may become the picture of a 
normal eye visually. 

[Claim 7] the time of carrying out field division of the xy flat surface for every field with the 
distribution configuration of the shape of an aforementioned mountain — the account of before - 

- for every pixel in the picture field specified beforehand in the reference field for a N line xM 
train (1 or more [ However, N and M ]) pixel centering on the view pixel of a number allotment 
processing object When the value of the aforementioned characteristic quantity of a view pixel is 
the maximum, a new number is assigned for this view pixel as a crest point. When the pixel which 
the value of the aforementioned characteristic quantity of a view pixel is not the maximum, and 
has the value of the maximum characteristic quantity other than the view pixel in the 
aforementioned reference field assigns and it has a number It repeats until one of crest point 
numbers is given about all the pixels in the picture field specified beforehand, the number 
allotment processing which gives this allotment number to a view pixel — the account of before 

— The image-processing method according to claim 6 of performing picture field division by 
making a set of a pixel with the same number into one field. 

[Claim 8] The pixel of a law is made into a view pixel, the time of carrying out field division of the 
xy flat surface for every field with the distribution configuration of the shape of an 
aforementioned mountain — the account of before — in each pixel in the picture field specified 
beforehand, a number is undecided — When the pixel which has the value of the aforemention d 
larger characteristic quantity than a view pixel is in the reference field for a N line xM train (1 or 
more [ However, N and M ]) pixel centering on this view pixel, Memorize the position of a view 
pixel and the processing whose value of the aforementioned characteristic quantity makes a 
large pixel the point paying [ new ] its attention is repeated. If the number of the aforementioned 
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point paying [ new ] its attention is undecided when the value of the characteristic quantity of 
the aforementioned point paying [ new ] its attention is the maximum in a refer nee field, a new 
' fiumbfer: will be assigned for this point paying [ new ] its attention as a crest point. The number 
allotment processing which will give the number to all the pixels of the coordinate which carried 
out [ aforementioned ] storage if the number is already assigned to the aforementioned point 
paying [ new ] its attention the account of before — the image-processing method according to 
claim 6 or 7 of performing picture field division by making a set of a pixel with the same number 
into one field repeatedly until one of crest point numbers is given about all the pixels in the 
picture field specified beforehand 

[Claim 9] The 1st mark as configuration information which serves as size in distinction of the 
color tone poor field of the aforementioned pupil using circularity characteristic quantity for 
every division field, so that it is more nearly circularly near, The 2nd mark as positional 
information which serves as size, so that the center of gravity of a division field is close to the 
center position of the appointed field, The 3rd mark as area information which serves as 
smallness, so that the ratio of the area of a division field and the area of the appointed field 
separates from the predetermined range, The average or more in any one of a hue, saturation, 
and lightness, maximum, Any one or more of the minimum value, contrast, and histogram 
configurations are used. The 4th mark as statistical picture characteristic quantity which shows 
a color tone poor degree from comparison with statistical color tone poor field information, And it 
asks according to the center position of a pupil specified beforehand, and the interval of both 
eyes. The image-processing method given in any 1 term of a claim 6 to the claim 8 which 
calculates at least one of five mark of 5th mark as positional information used as smallness, 
so that it separates from the center of a pupil, and judges what has the highest mark to be a 
color tone poor field. 

[Claim 10] The image-processing method according to claim 9 of judging the field of a high order 
L (however, L one or more integers) individual by any two or more aforementioned averages of 
mark or weighted average mark to be a color tone poor field. 

[Claim 11] The picture field including the eye field which became poor [ a color tone ] specified 
beforehand is made into xy flat surface. Picture characteristic quantity is calculated for every 
pixel with any one or two combination or more in a hue, saturation, and lightness. Set up the ?- 
dimensional xyz space which arranges this characteristic quantity to the z-axis, and field divis ion 
of the xy flat surface is carried out for every field in which the value of the z-axis has a 
mountain-like distribution configuration to the breadth of xy flat surface. With any one or two 
combination or more in the configuration information on xy flat surface of each division field, 
positional information, area information, and statistical picture characteristic quantity The 
maximum lightness position of the color tone poor field of the pupil which distinguished the color 
tone poor field of a pupil and was distinguished from the color tone poor field is distinguished 
from a catch light position. The image-processing method which makes the correction including 
the processing which forms a catch light pattern in this catch light position, and corrects the 
color tone poor field of the aforementioned pupil so that it may become the picture of a normal 
eye visually. 

[Claim 12] the time of carrying out field division of the xy flat surface for every field with the 
distribution configuration of the shape of an aforementioned mountain — the account of before - 

- for every pixel in the picture field specified beforehand in the reference field for a N line xM 
train (1 or more [ However, N and M ]) pixel centering on the view pixel of a number allotment 
processing object When the value of the aforementioned characteristic quantity of a view pixel is 
the maximum, a new number is assigned for this view pixel as a crest point. When the pixel which 
the value of the aforementioned characteristic quantity of a view pixel is not the maximum, and 
has the value of the maximum characteristic quantity other than the view pixel in the 
aforementioned reference field assigns and it has a number It repeats until one of crest point 
numbers is given about all the pixels in the picture field specified b forehand, the number 
allotment processing which gives this allotment number to a view pixel — the account of before 

— The image-processing method according to claim 1 1 of performing picture field division by 
making a set of a pixel with the same number into one field. 
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[Claim 1 3] The pixel of a law is made into a view pixel, the time of carrying out field division of 
the xy flat surface for every field with the distribution configuration of the shape of an 
■ aforementioned mountain — the account of before — in each pixel in the picture field specified 
beforehand, a number is undecided — When the pixel which has the value of the aforementioned 
larger characteristic quantity than a view pixel is in the reference field for a N line xM train (1 or 
more [ However, N and M ]) pixel centering on this view pixel, Memorize th position of a view 
pixel and the processing whose value of the aforementioned characteristic quantity makes a 
large pixel the point paying [ new ] its attention is repeated. If the number of the aforementioned 
point paying [ new ] its attention is undecided when the value of the characteristic quantity of 
the aforementioned point paying [ new ] its attention is the maximum in a reference field, a new 
number will be assigned for this point paying [ new ] its attention as a crest point. The number 
allotment processing which will give the number to all the pixels of the coordinate which carried 
out [ aforementioned ] storage if the number is already assigned to the aforementioned point 
paying [ new ] its attention the account of before — the image-processing method according to 
claim 11 or 12 of performing picture field division by making a set of a pixel with the same 
number into one field repeatedly until one of crest point numbers is given about all the pixels in 
the picture field specified beforehand 

[Claim 14] The 1st mark as configuration information which serves as size in distinction of the 
color tone poor field of the aforementioned pupil using circularity characteristic quantity for 
every division field, so that it is more nearly circularly near, The 2nd mark as positional 
information which serves as size, so that the center of gravity of a division field is close to the 
center position of the appointed field. The 3rd mark as area information which serves as 
smallness, so that the ratio of the area of a division field and the area of the appointed field 
separates from the predetermined range, The average or more in any one of a hue, saturation, 
and lightness, maximum, Any one or more of the minimum value, contrast, and histogram 
configurations are used. The 4th mark as statistical picture characteristic quantity which shows 
a color tone poor degree from comparison with statistical color tone poor field information, And it 
asks according to the center position of a pupil specified beforehand, and the interval of both 
eyes. The image-processing method given in any 1 term of a claim 11 to the claim 13 which 
calculates at least one of five mark of 5th mark ** as positional information used as smallness, 
so that it separates from the center of a pupil, and judges what has the highest mark to be a 
color tone poor field. 

[Claim 15] The image-processing method according to claim 14 of judging the field of a high 
order L (however, L one or more integers) individual by any two or more aforementioned 
averages of mark or weighted average mark to be a color tone poor field. 

[Claim 16] The picture field including the eye field which became poor [ a color tone ] specified 
beforehand is made into xy flat surface. Picture characteristic quantity is calculated for every 
pixel with any one or two combination or more in a hue, saturation, and lightness. Set up the 3- 
dimensional xyz space which arranges this characteristic quantity to the z-axis, and field division 
of the xy flat surface is carried out for every field in which the value of the z-axis has a 
mountain-like distribution configuration to the breadth of xy flat surface. With any one or two 
combination or more in the configuration information on xy flat surface of each division field, 
positional information, area information, and statistical picture characteristic quantity The pupil 
of color tone normalcy started from the normal pupil field so that the size of the pupil field which 
distinguished the color tone poor field of a pupil and was distinguished from the color tone poor 
field might be suited After enlarging or contracting, The image-processing method which makes 
the correction including the processing stuck on the pupil field distinguished from the 
aforementioned color tone poor field, and corrects the color tone poor field of the 
aforementioned pupil so that it may becom the picture of a normal eye visually. 
[Claim 1 7] the tim of carrying out field division of the xy flat surface for every field with the 
distribution configuration of the shape of an aforementioned mountain — the account of before - 
- for every pixel in the picture field specified beforehand in the reference field for a N line xM 
train (1 or more [ However, N and M ]) pixel centering on the view pixel of a number allotment 
processing object When the value of the aforementioned characteristic quantity of a view pixel is 
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the maximum, a new number is assigned for this view pixel as a crest point. When the pixel which 
the value of the aforementioned characteristic quantity of a view pixel is not the maximum, and 
1 has thre, value of the maximum characteristic quantity other than the view pixel in the 
aforementioned reference field assigns and it has a number It repeats until one of crest point 
numbers is given about all the pixels in the picture field specified beforehand, the number 
allotment processing which gives this allotment number to a view pixel — the account of before 
— The image-processing method according to claim 16 of performing picture field division by 
making a set of a pixel with the same number into one field. 

[Claim 18] The pixel of a law is made into a view pixel, the time of carrying out field division of 
the xy flat surface for every field with the distribution configuration of the shape of an 
aforementioned mountain — the account of before — in each pixel in the picture field specified 
beforehand, a number is undecided — When the pixel which has the value of the aforementioned 
larger characteristic quantity than a view pixel is in the reference field for a N line xM train (1 or 
more [ However, N and M ]) pixel centering on this view pixel, Memorize the position of a view 
pixel and the processing whose value of the aforementioned characteristic quantity makes a 
large pixel the point paying [ new ] its attention is repeated. If the number of the aforementioned 
point paying [ new ] its attention is undecided when the value of the characteristic quantity of 
the aforementioned point paying [ new ] its attention is the maximum in a reference field, a new 
number will be assigned for this point paying [ new ] its attention as a crest point. The number 
allotment processing which will give the number to all the pixels of the coordinate which carried 
out [ aforementioned ] storage if the number is already assigned to the aforementioned point 
paying [ new ] its attention the account of before — the image-processing method according to 
claim 16 or 17 of performing picture field division by making a set of a pixel with the same 
number into one field repeatedly until one of crest point numbers is given about all the pixels in 
the picture field specified beforehand 

[Claim 19] The 1st mark as configuration information which serves as size in distinction of the 
color tone poor field of the aforementioned pupil using circularity characteristic quantity for 
every division field, so that it is more nearly circularly near, The 2nd mark as positional 
information which serves as size, so that the center of gravity of a division field is close to the 
center position of the appointed field, The 3rd mark as area information which serves as 
smallness, so that the ratio of the area of a division field and the area of the appointed field 
separates from the predetermined range, The average or more in any one of a hue, saturation, 
and lightness, maximum, Any one or more of the minimum value, contrast, and histogram 
configurations are used. The 4th mark as statistical picture characteristic quantity which shows 
a color tone poor degree from comparison with statistical color tone poor field information, And it 
asks according to the center position of a pupil specified beforehand, and the interval of both 
eyes. The image-processing method given in any 1 term of a claim 16 to the claim 18 which 
calculates at least one of five mark of 5th mark as positional information used as smallness, 
so that it separates from the center of a pupil, and judges what has the highest mark to be a 
color tone poor field. 

[Claim 20] The image-processing method according to claim 19 of judging the field of a high 
order L (however, L one or more integers) individual by any two or more aforementioned 
averages of mark or weighted average mark to be a color tone poor field. 
[Claim 21] The image-processing method given in any 1 term of a claim 1 to the claim 20 
modified so that the atmosphere of the picture of both eyes may gather, when both eyes correct 
a poor color tone so that the picture of the eye containing the corrected pupil portion and the 
picture of the unnecessary eye of correction may serve as the same atmosphere or. 
[Claim 22] The image-processing method given in any 1 term of a claim 1 to the claim 21 which 
changes the kind of characteristic quantity which changes the characteristic quantity used for 
the field division technique of a picture, or field division according to the number of times of 
specification of the appointed field including the eye field where the aforementioned color tone is 
poor, or is used for a color tone poor field judging, the calculation method of characteristic 
quantity, or a criterion, or changes the correction method of a color tone poor field. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] Especially this invention relates to the image- 
processing method which detects and corrects the poor color tone of the pupil of the 
photographic subject in a digital image about the image-processing method. 
[0002] 

[Description of the Prior Art] There is a case where it is conventionally reflected as a picture of 
the color in which a photographic subject differs from practice according to the reflective state 
of the light under photography, plentifully, these bloodshot eyes are too unnatural, and since 
appearance is bad, correcting so that it may look automatically by the image processing is made. 
[0003] For example, if a person is photoed from a transverse plane by the stroboscope, the so- 
called bloodshot-eyes phenomenon in which a pupil is reflected crimson or golden may arise. 
When the light of a stroboscope carries out incidence from a transverse plane to the eye in the 
state where the pupil opened in a dark place, this bloodshot-eyes phenomenon is a phenomenon 
which happens in order to reflect the light of a stroboscope regularly and to reflect this state to 
a picture, and has the bloodshot eyes to which a pupil is reflected red, and the monetary value to 
which a pupil is reflected golden (bloodshot eyes are henceforth called including both.). 
[0004] Since such bloodshot eyes have bad projection glory, the various image-processing 
methods for correcting these bloodshot eyes conventionally are proposed. For example, in JP,7- 
72537,A, the block definition of the circumference of the eye used as the candidate for 
bloodshot-eyes correction is carried out, threshold processing in saturation, brightness, and a 
hue is performed in this field, and if the target pixel is in the threshold defined beforehand, the 
method of judging it as bloodshot eyes and correcting is mentioned. Moreover, in JP,9-261580,A, 
a pupil candidate field is chosen based on the sexual desire news and colour information in the 
field surrounded by the edge, and the method of making bloodshot-eyes correction is mentioned 
by correcting the color tone poor pixel in all the selected pupil candidate fields. 
[0005] 

[Problem(s) to be Solved by the Invention] However, by the conventional methods, such as JP,7- 
72537,A mentioned above and JP,9-261580,A, a bloodshot-eyes field is distinguished by 
threshold processing in saturation, brightness, and a hue, and it is correcting, and since the 
saturation of bloodshot eyes, brightness, and a hue are broad, it is not avoided that incorrect 
extraction and the leakage in extraction take place in many samples. Moreover, for example, a 
beige portion is also corrected black with bloodshot-eyes processing of a pupil, and there is also 
a possibility of becoming the picture which has sense of incongruity as a result. 
[0006] Moreover, in the case where the edge of a picture is extracted like JP.9-261 580,A, 
generally, since the edge of a picture is quite complicated, it also has superfluous division and a 
possibility that a field division mistake may occur. 

[0007] That is, since it distinguishes whether they are bloodshot eyes only by the threshold of a 
color by the former method, without dividing for every field, and a field without th need for 
correction is easy to be detected with the required field of correction as a correction object 
domain and cannot divide a field correctly by the latter method, there is a problem that it is 



http://www4.ipdl.jpo.gojp/cgi-bin/tran_web_cgi_ejje 



03/09/09 



2/14 ^— V 



difficult to correct only the pupil field which is a correction object domain. 

[0008] Then, no matter this invention may be what picture, it sets it as the 1 st purpose to offer 
" 'the image-processing method which can choose only the field which divides a field correctly and 
has the need for correction as a correction object domain. Moreover, it sets it as the 2nd 
purpose to offer the image-processing method which can choose only a pupil field correctly. 
Furthermore, it sets it as the 3rd purpose to offer correctly the image-processing method which 
can correct for the pupil field which is a correction object domain. Moreover, it sets it as the 4th 
purpose to offer the image-processing method which can make a natural atmosphere to the 
corrected picture. 
[0009] 

[Means for Solving the Problem] In order to attain the 1st purpose of the above, the picture fi Id 
including the eye field which became poor [ a color tone ] specified beforehand is made into xy 
flat surface. Picture characteristic quantity is calculated for every pixel with any one or two 
combination or more in a hue, saturation, and lightness. Set up the 3-dimensional xyz space 
which arranges this characteristic quantity to the z-axis, and field division of the xy flat surface 
is carried out for every field in which the value of the z-axis has a mountain-like distribution 
configuration to the breadth of xy flat surface. With any one or two combination or more in the 
configuration information on xy flat surface of each division field, positional information, area 
information, and statistical picture characteristic quantity, the color tone poor field of a pupil is 
distinguished, and a color tone poor field and the distinguished field are corrected so that it may 
become the picture of a normal eye visually. 

[0010] That is, this invention is the method of starting collectively and correcting color tone poor 
fields, such as a bloodshot-eyes field including the catch light portion. As for a bloodshot-eyes 
portion, since the reflection from a retina is as strong as the center of the pupil section, 
lightness has the inclination to fall towards a periphery from a center. Therefore, it uses that 
lightness also including a catch light is distributed in the shape of a mountain. Moreover, with the 
Brown system pupil, the iris section uses the valley and bird clapper of lightness, and the iris 
section uses the valley and bird clapper with the pupil section which became bloodshot eyes 
about the size of the value of redness in a blue system pupil. 

[001 1] That is, it uses that a valley is made between the bloodshot-eyes section, its adjoining 
pewter, and the skin section using the characteristic quantity which combined lightness and 
redness, and the bloodshot-eyes section is separated with pewter and the skin section by 
carrying out field division for^every mountain of the aforementioned characteristic quantity. 
[0012] Moreover, in case invention of a claim 2 carries out field division of the xy flat surface for 
every field with the distribution configuration of the shape of an aforementioned mountain the 
account of before — for every pixel in the picture field specified beforehand in the reference 
field for a N line xM train (1 or more [ However, N and M ]) pixel centering on the view pixel of a 
number allotment processing object When the value of the aforementioned characteristic 
quantity of a view pixel is the maximum, a new number is assigned for this view pixel as a crest 
point. When the pixel which the value of the aforementioned characteristic quantity of a view 
pixel is not the maximum, and has the value of the maximum characteristic quantity other than 
the view pixel in the aforementioned reference field assigns and it has a number the number 
allotment processing which gives this allotment number — the account of before — picture field 
division is performed by making a set of a pixel with the same number into one field repeatedly 
until one of crest point numbers is given about all the pixels in the picture field specified 
beforehand According to this method, since field division can be carried out to program 
processing etc., it troubles a user and is desirable. 

[0013] Furthermore, in case invention according to claim 3 carries out field division of the xy flat 
surface for every field with the distribution configuration of the shape of an aforementioned 
mountain The pixel of a law is made into a view pixel, the account of before — in each pix I in 
the picture field specified beforehand, a number is undecided — When the pixel which has the 
value of the aforementioned larger characteristic quantity than the point paying [ present ] its 
attention is in the reference field for a N line xM train (1 or more [ However, N arid M ]) pixel 
centering on this view pixel, The processing whose value of the aforementioned characteristic 
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quantity carry out the accumulation storage of the position of the point paying [ present ] one's 
attention, and makes a large pixel the point paying [ new ] its attention is repeated. If the number 
• ,of the aforementioned point paying [ new ] its attention is undecided when the value of the 
characteristic quantity of the aforementioned point paying [ new ] its attention is the maximum 
in a ref rence field, a new number will be assigned for this point paying [ new ] its attention as a 
crest point. The number allotment processing which will give the number to all the pixels of the 
coordinate which carried out [ aforementioned ] accumulation if the number is already assigned 
to the aforementioned point paying [ new ] its attention the account of before — picture field 
division is performed by making a set of a pixel with the same number into one field repeatedly 
until one of crest point numbers is given about all the pixels in the picture field specified 
beforehand 

[0014] Thus, about the pixel which cannot give a number, the position is memorized as a 
coordinate, for example, and if a number is given to the pixel which became a point paying 
[ new ] its attention at the last, processing which carries out field division for every mountain of 
the aforementioned characteristic quantity can be performed at high speed by processing so that 
the number of the pixel which finally became a point paying [ new ] its attention may be given to 
all the pixels of the memorized coordinate. 

[0015] Invention of a claim 4 is set to distinction of the color tone poor field of the 
aforementioned pupil in the image-processing method according to claim 1. The 1st mark as 
configuration information which serves as size using circularity characteristic quantity for every 
division field, so that it is more nearly circularly near, The 2nd mark as positional information 
which serves as size, so that the center of gravity of a division field is close to the center 
position of the appointed field, The 3rd mark as area information which serves as smallness, so 
that the ratio of the area of a division field and the area of the appointed field separates from 
the predetermined range, The average or more in any one of a hue, saturation, and lightness, 
maximum, Any one or more of the minimum value, contrast, and histogram configurations are 
used. The 4th mark as statistical picture characteristic quantity which shows a color tone poor 
degree from comparison with statistical color tone poor field information, And it asks according 
to the center position of a pupil specified beforehand, and the interval of both eyes, at least one 
of five mark of the 5th mark as positional information used as smallness is calculated, so that it 
separates from the center of a pupil, and what has the highest mark is judged to be a color tone 
poor field. 

[0016] Namely, invention according to claim 4 is the method of judging color tone poor fields, 
such as a division field according to claim 1 to a bloodshot-eyes field. It converts into the 1 st 
which has an inclination used as low mark - the 5th mark, and a color tone poor field is 
distinguished using at least one of these [ 1st ] - the 5th mark as the portion respectively near a 
pupil keeps away the statistical characteristic quantity about the configuration of a division field, 
area, a position, and concentration from high mark and a pupil. 

[0017] In addition, if the diameter of a pupil is computed based on the center of a pupil specified 
beforehand, and the interval of both eyes from there being a relation of becoming the diameter of 
a pupil if the multiplication of the predetermined coefficient (generally 0.07-0.1 1) is carried out to 
the interval of both eyes, the inside of the circle-like field which has this diameter has the 
highest mark and the 5th mark separate from a center, they have the inclination for mark to 
become low. 

[0018] Preferably, as indicated to the claim 5, it is good to judge the field of a high order L 
(however, L one or more integers) individual by the number of the average mark or weighted 
average mark or more in any two of the five aforementioned mark to be a color tone poor field. 
Since the inclination of each field is differentiated more and becomes clear by taking a weighted 
average, a color tone poor field can be distinguished with a sufficient precision. 
[0019] In order to attain the above 3rd and the 4th purpose, moreover, invention of a claim 6 The 
picture field including the eye field which became poor [ a color tone ] specified beforehand is 
made into xy flat surface. Picture characteristic quantity is calculated for every pixel with any 
one or two combination or more in a hue, saturation, and lightness. Set up the 3-dimensional xyz 
space which arranges this characteristic quantity to the z-axis, and field division of the xy flat 
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surface is carried out for every field in which the value of the z-axis has a mountain-like 
distribution configuration to the breadth of xy flat surface. With any one or two combination or 
■ more m.the configuration information on xy flat surface of each division field, positional 
information, area information, and statistical picture characteristic quantity The correction 
including the processing to which gradation is applied so that it may apply to a center section 
from the periphery of the color tone poor field of the pupil which distinguished the color tone 
poor field of a pupil and was distinguished from the color tone poor field and both lightness, and 
both [ any one or ] may fall gradually is made. The color tone poor field of the aforementioned 
pupil Is corrected so that it may become the picture of a normal eye visually. 
[0020] Namely, in invention 4>f a claim 6, since the aforementioned color tone poor field is 
distinguished by the same method as the above-mentioned claim 1 , it can separate into pewter 
and the skin section, and accuracy, and color tone poor fields, such as bloodshot eyes, can be 
corrected with a sufficient precision. 

[0021] In order to attain the 4th purpose of the above by invention of a claim 6 in addition to it, 
processing to which gradation is applied is performed so that it may apply to a center section 
from a periphery and both lightness, and both [ any one or ] may fall gradually in the case of 
correction of the color tone poor field of a pupil. Since the direction of the color for a center 
section serves as a color of the actual pupil portion used as the color deeper than a part for a 
periphery from this closely, the pupil picture after correction can be made into a natural 
atmosphere. In addition, since a claim 9 has the same operation as the above-mentioned claim 2 
to the claim 5 from a claim 7, explanation is omitted. 

[0022] Moreover, invention of a claim 10 makes the picture field including the eye field which 
became poor [ a color tone ] specified beforehand xy flat surface. Picture characteristic quantity 
is calculated for every pixel with any one or two combination or more in a hue, saturation, and 
lightness. Set up the 3-dimensional xyz space which arranges this characteristic quantity to the 
z-axis, and field division of the xy flat surface is carried out for every field in which the value of 
the z-axis has a mountain-like distribution configuration to the breadth of xy flat surface. With 
any one or two combination or more in the configuration information on xy flat surface of each 
division field, positional information, area information, and statistical picture characteristic 
quantity The maximum lightness position of the color tone poor field of the pupil which 
distinguished the color tone poor field of a pupil and was distinguished from the color tone poor 
field is distinguished from a catch light position. The correction including the processing which 
forms a catch light pattern in this catch light position is made, and the color tone poor field of 
the aforementioned pupil is corrected so that it may become the picture of a normal eye visually. 

[0023] Namely, in invention of a claim 10, since the aforementioned color tone poor field is 
distinguished by the same method as the above-mentioned claim 1 like the above-mentioned 
claim 6, it can separate into pewter and the skin section, and accuracy, and color tone poor 
fields, such as bloodshot eyes, can be corrected with a sufficient precision. 
[0024] In addition to it, by invention of a claim 10, the maximum lightness position in the field of 
a pupil portion is distinguished from a catch light position, and the catch light pattern is formed. 
Namely, since it is the field where concentration is thin partially in a pupil portion with deep 
concentration, as for a catch light, it turns out that a catch light position is brightest position. 
Therefore, the picture of the eye of the impression which was natural and was lively is acquired 
by performing processing which prepares a catch light in the maximum lightness position in the 
field of a pupil portion. In addition, since a claim 1 5 has the same operation as the above- 
mentioned claim 2 to the claim 5 from a claim 1 1, explanation is omitted. 

[0025] Invention of a claim 16 makes the picture field including the eye field which became poor 
[ a color tone ] specified beforehand xy flat surface. Picture characteristic quantity is calculated 
for every pixel with any one or two combination or more in a hue, saturation, and lightness. Set 
up the 3-dimensional xyz space which arranges this characteristic quantity to the z-axis, and 
field division of the xy flat surface is carried out for every field in which the value of the z-axis 
has a mountain-like distribution configuration to the breadth of xy flat surface. With any one or 
two combination or more in the configuration information on xy flat surface of each division field, 
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positional information, area information, and statistical picture characteristic quantity The pupil 
of color tone normalcy started from the normal pupil field so that the size of the pupil field which 
* distingyished the color tone poor field of a pupil and was distinguished from the color tone poor 
field might be suited After enlarging or contracting, The correction including the processing stuck 
on the pupil field distinguished from the aforementioned color tone poor fi Id is made, and the 
color tone poor field of the aforementioned pupil is corrected so that it may become the picture 
of a normal eye visually. 

[0026] That is, by comparatively easy correction processing, since enlarging or contracting of the 
pupil of color tone normalcy started from the normal pupil field is carried out to the pupil field 
distinguished from the color tone poor field and invention of a claim 16 sticks it on it, it can 
correct the color tone poor field of a pupil so that it may become the picture of a normal eye 
visually. In addition, since a claim 20 has the same operation as the above-mentioned claim 2 to 
the claim 5 from a claim 1 7, explanation is omitted. 

[0027] In order to attain the 4th purpose of the above, furthermore, invention of a claim 21 In the 
image-processing method given in any 1 term of a claim 1 to the claim 21 According to the 
number of times of specification of the appointed field including the eye field where the 
aforementioned color tone is poor, the characteristic quantity used for the field division 
technique of a picture or field division is changed. Or the kind of characteristic quantity used for 
a color tone poor field judging, the calculation method of characteristic quantity, or a criterion is 
changed, or the correction method of a color tone poor field is changed. 
[0028] Since it can shift or fine correction of making the color of the corrected eye into the 
same atmosphere as the color of another [ without the need for correction ] eye can make, it is 
possible to make a natural atmosphere so that the position of the picture of the eye which 
compared and corrected the position of another [ without the need for correction ] eye and th 
position of the picture of the corrected eye by this may be arranged in a natural position. 
Moreover, position amendment of a catch light is also performed so that the physical relationship 
in the pupil of a catch light may gather by both eyes. 

[0029] When invention of a claim 22 performs bloodshot-eyes correction processing two or more 
times, are invention, and it sets to the image-processing method given in any 1 term of a claim 1 
to the claim 21. According to the number of times of specification of the appointed field including 
the eye field where the aforementioned color tone is poor, the characteristic quantity used for 
the field division technique of a picture or field division is changed. Or the kind of characteristic 
quantity used for a color tone poor field judging, the calculation method of characteristic 
quantity, or a criterion is changed, or the correction method of a color tone poor field is changed. 

[0030] For example, when a bloodshot-eyes field criterion is field division the whole mountain of 
the above-mentioned characteristic quantity, the bloodshot-eyes field criterion which is a two- 
times eye is changed into the field division by the degree of similar of a tint instead of field 
division the whole mountain of the above-mentioned characteristic quantity, or excepting the 
area criteria which excepted or used the circularity criteria used by the first judgment in the 
judgment by the first judgment etc. is mentioned. 
[0031] 

[The operation form of invention] The outline composition of the digital language laboratory 
system 1 0 concerning this operation form is shown in drawing 1 and drawing 2 . 
[0032] As shown in drawing 1 , this digital language laboratory system 10 is constituted including 
the line CCD scanner 14, the image-processing section 16, the LASER beam printer section 18, 
and the processor section 20, the line CCD scanner 14 and the image-processing section 16 are 
unified as the input section 26 shown in dr awin g 2 , and the LASER beam printer section 18 and 
the processor section 20 are unified as the output section 28 shown in drawing 2 . 
[0033] The line CCD scanner 14 is for reading the coma picture currently recorded on 
photographic films, such as a negative film and a reversal film, for example, can set the coma 
picture of the photographic film of the photographic film of 1 35 sizes, the photographic film of 
1 10 sizes and the photographic film (photographic film : the so-called APS film of 240 sizes) in 
which the transparent magnetic layer was formed, 120 sizes, and 220 sizes (brownie size) as the 
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reading object. After the line CCD scanner 14 reads the coma picture for [ above ] reading with 
a line CCD 30 and it carries out A/D conversion in the A/D-conversion section 32, it outputs 
• image *d,ata to the image-processing section 16. 

[0034] In addition, the form of this operation explains as digital language laboratory system 10 at 
the time of applying the photographic film (APS film) 68 of 240 sizes. 

[0035] While the image data (scanning image data) outputted from the line CCD scanner 14 is 
inputted, the image-processing section 16 The image data obtained by photography in digital 
camera 34 grade, the image data obtained by reading manuscripts (for example, reflection copy 
etc.) with a scanner 36 (flat bed type), The image data which was generated by other computers 
and recorded on the floppy disk drive 38, MO drive, or the CD drive 40, And it is constituted so 
that it may also be possible to input from the outside the communication image data which 
receives through a modem 42 (for these to be hereafter named file image data generically). 
[0036] The image-processing section 1 6 memorizes the inputted image data to an image memory 
44, performs image processings, such as various kinds of amendments of the color gradation 
processing section 46, the hyper-tone processing section 48, and hyper-sharpness processing 
section 50 grade, and outputs them to the LASER beam printer section 1 8 as image data for 
record. Moreover, the thing (for example, output to storages, such as FD, MO, and CD, or it 
transmits to other information management systems through a communication line) of the image- 
processing section 16 outputted to the exterior by making into an image file the image data 
which performed the image processing is also made possible. 

[0037] The LASER beam printer section 1 8 is equipped with the laser light source 52 of R, G, 
and B, controls the laser driver 54, irradiates the laser beam modulated according to the image 
data for record (an image memory 56 once memorizes) inputted from the image-processing 
section 1 6 at printing paper, and records a picture on printing paper 62 by scanning exposure 
(optical system which mainly used the polygon mirror 58 and the ftheta lens 60 with the gestalt 
of this operation). Moreover, the processor section 20 performs each processing of the color 
development, bleaching fixing, rinsing, and dryness to the printing paper 62 in which the picture 
was recorded by scanning exposure in the LASER beam printer section 18. Thereby, a picture is 
formed on printing paper. 

[0038] (Composition of a line CCD scanner) The composition of the line CCD scanner 14 is 
explained below. The outline composition of the optical system of the line CCD scanner 14 is 
shown in d rawi ng 1 . This optical system equips the photographic film 68 with the light source 66 
which irradiates light, and the optical diffusion board 72 which makes the diffused light light which 
irradiates a photographic film 68 is arranged at the irradiation appearance side of the light source 
66. 

[0039] A photographic film 68 is conveyed by the tape carrier package 74 arranged at the side in 
which the optical diffusion board 72 was arranged so that the screen of a coma picture may 
become an optical axis and a perpendicular. 

[0040] On both sides of the photographic film 68, the lens unit 76 and Line CCD 30 to which 
image formation of the light which penetrated the coma picture is carried out are arranged in 
order along with the optical axis at the light source 66 and the opposite side. In addition, 
although only the lens single as a lens unit 76 is shown, the lens unit 76 is the zoom lens which 
consisted of two or more lenses in fact. In addition, you may use a selfoc lens as a lens unit 76. 
In this case, it is desirable to make the ends side of a selfoc lens approach a photographic film 
68 and a line CCD 30 as much as possible, respectively. 

[0041] The sensing section in which it has been arranged at the single tier along the cross 
direction of two or more photographic films 68 by which CCD cell conveyance is carried out, and 
the electronic shutter style was prepared vacates an interval, and is prepared three lines in 
parallel mutually, it is respectively attached in the optical incidence side of each sensing section 
any of the color separation filter of R, G, and B they are, and the line CCD 30 is constituted (the 
so-called three-line color CCD). The line CCD 30 is arranged so that the light-receiving side of 
each sensing section may be in agreement with the image formation point position of the lens 
unit 76. 

[0042] Moreover, although illustration is omitted, the shutter is formed between the line CCD 30 
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and the lens unit 76. 

(Composition of the control system of the image-processing section 16) The detailed control- 
* .block'yiew for performing each processing of the image memory 44 which is the main 
composition of the image-processing section 1 6 shown in drawing 1 , the color gradation 
processing 46, the hyper-tone processing 48, and the hyper-sharpness processing 50 is shown in 
drawing 3 . 

[0043] In the data-processing section 200, each digital signal of RGB outputted from the line 
CCD scanner 14 is changed into digital image data (concentration data) by the log converter 202, 
after predetermined data processing, such as amendment, defective pixel amendment, and a 
shading compensation, is performed at the time of dark, press can data are memorized by the 
press can memory 204, and fine scan data are memorized by the fine scan memory 206. 
[0044] The press can data memorized by the press can memory 204 are sent out to the press 
can processing section 212 which consisted of the image-data-processing section 208 and an 
image data transducer 210. On the other hand, the fine scan data memorized by the fine scan 
memory 206 are sent out to the fine scanning-and-processing section 218 which consisted of 
the image-data-processing section 214 and an image data transducer 216. 

[0045] In these press can processing sections 212 and the fine scanning-and-processing section 
218, when a picture is photoed, amendment based on the stroboscope luminous-intensity- 
distribution property when taking a photograph at which the lens property and the stroboscop 
were used etc. is performed. 

[0046] Moreover, the lens property data feed zone 234 which outputs the lens property 
according to the photography camera which acquires the information which distinguishes the 
camera which photoed the film from the film property storage section 232 which memorizes the 
property of various films, and corresponds is connected to the image-data-processing sections 
208 and 214. 

[0047] The property of a film is a gradation property (gamma characteristics), and, generally it is 
expressed with the curve from which concentration changes in three dimensions according to 
light exposure. In addition, since this point is well-known technology, detailed explanation is 
omitted. 

[0048] Moreover, if specification of a film kind is the form of this operation, the information which 
shows a film kind is recorded on the magnetic-recording layer of an APS film, and it can be read 
by the magnetic head at the time of conveyance with the carrier 74 of the line CCD scanner 14. 
Moreover, in the case of a 135 size film, you may judge in the configuration (perforation is 
prepared in crosswise ends in the comparatively short pitch) etc., and an operator may be made 
to key to it. By specifying a film kind, the relative concentration from the film base concentration 
of a picture is correctly computable. 

[0049] In the image-data-processing sections 208 and 214, a reference value is amended 
according to the film kind and camera kind which are acquired from the film property storage 
section 232 and the lens property data feed zone 234, and color-balance adjustment, contrast 
adjustment (color gradation processing), luminosity amendment, saturation amendment (hyper- 
tone processing), hyper-sharpness processing, etc. are performed according to LUT, a matrix 
(MTX) operation, etc. 

[0050] Moreover, the bloodshot-eyes processing sections 220 and 222 which correct to a 
natural color the pupil portion which became bloodshot eyes after each aforementioned 
adjustment and amendment are formed in the image-data-processing sections 208 and 214. 
About the bloodshot-eyes correction in these bloodshot-eyes processing sections 220 and 222, 
it mentions later. 

[0051] It has changed into the image data for a display for displaying the image data processed 
by the image-data-processing section 208 on monitor 16M based on 3D-LUT in the imag data 
transducer 210 by the side of a press can. On the other hand, in the image data transducer 216 
by the side of a fine scan, the image data processed by the image-data-processing section 214 
is changed into the image data for a print in the LASER b am printer section 18 based on 3D- 
LUT. In addition, the image data and the image data for a print for the above-mentioned display 
are aiming at coincidence by following various amendments, although color coordinate systems 
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differ. 

[0052] That is, the conditioning section 224 is connected to the press can processing section 
■•212 and the fine scanning-and-processing section 218. The conditioning section 224 consists of 
the setup section 226, the key amendment section 228, and the parameter integrated section 
230. 

[0053] Using press can data, the setup section 226 sets up the reading conditions of a fine scan, 
supplies them to the line CCD scanner 1 4, and calculates the image-processing conditions of the 
press can processing section 212 and the fine scanning-and-processing section 218, and 
supplies them to the parameter integrated section 230. 

[0054] According to various kinds of directions inputted with the key which adjusts the 
concentration set as keyboard 16K, a color, contrast, sharpness, saturation, etc., or the mouse, 
the key amendment section 228 calculates the amount of adjustments of image-processing 
conditions, and supplies it to the parameter integrated section 230. 

[0055] In the parameter integrated section 230, the image-processing conditions received from 
the above-mentioned setup section 226 and the key amendment section 228 are sent to the 
image-data-processing section 208,214 by the side of a press can and a fine scan, and image- 
processing conditions are amended or reconfigured. 

[0056] Here, the bloodshot-eyes correction in the bloodshot-eyes processing sections 220 and 
222 is explained, referring to the flow view of drawing 4 . 

[0057] At Step 1 00, color-balance adjustment, contrast adjustment, luminosity amendment, 
saturation amendment (hyper-tone processing), hyper-sharpness processing, etc. specify the 
picture of the eye used as bloodshot eyes as a processing-object field including the 
circumference out of the picture which various amendment processings, such as LUT and a 
matrix (MTX) operation, were performed, and was displayed on monitor 1 6M. 
[0058] Specification of a processing-object field can be performed by inputting from the key 
amendment section 228 by the operator, or boiling the image-data-processing section 214 and 
therefore extracting the field which red is concentrating partially within a picture. With this 
operation gestalt, the processing-object field is specified from the key amendment section 228 
by the key input by the operator. 

[0059] In addition, as the specification method of the processing-object field by the operator, as 
shown in drawing 1 1 (A) - (F), it chooses from the six modes, both the eye package specification 
mode 1, both the eye package specification mode 2, the independent specification mode 1, the 
independent specification mode 2, the independent specification mode 3, and the independent 
specification mode 4, and can specify, for example. 

[0060] Both the eye package specification mode 1 is the mode in which surround by the 
rectangle-like frame 1 3 with a mouse, a keyboard, etc. in which the field containing the boundary 
region of both eyes and both eyes was established by the image-processing section 16, and the 
field in a frame 1 3 is specified, as shown in drawing 1 1 (A). In this case, as the dashed line of 
drawing 1 1 (A) shows, it specifies by the predetermined ratio from both the outsides of the major 
axis of the frame 13 which ##***#(ed), and a field is divided, and let the obtained division field be 
a processing-object field. In addition, a predetermined ratio is a ratio which computes 
statistically the ratio of the size of the eye to the size of the major axis of a frame 13, and 
obtained, and respectively, including at least one eye, the divided field is set up so that the field 
of a glabella may be removed. In addition, a frame 13 is good also as other configurations, such 
as not only the shape of a rectangle but elliptical. 

[0061] Moreover, both the eye package specification mode 2 is the mode in which specify with a 
mouse, a keyboard, etc. in which the core of the pupil of both eyes was established by the 
image-processing section 16, and the field containing the boundary region of both eyes and both 
eyes is specified, as shown in drawing 1 1 (B). In this case, the field of th shape of an ellipse 
which makes length which serves as a predetermined ratio from the ends of th straight line 
which connects the specified core of the pupil of both eyes one half of the length of a major axis 
is made into the field of each eye, and let the obtained division field be a processing-object field. 

[0062] In addition, also in this case, like both the above-mentioned eye package specification 
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mode 1, it is the ratio which computes statistically the ratio of the size of the eye to the straight 
line which connects the core of the pupil of both eyes specified to be a predetermined ratio, and 
- is obtained, and respectively, including at least one eye, an ellipse-like field is set up so that the 
field of a glabella may be removed. 

[0063] Moreover, in both the above-mentioned eye package specification mode 1 and both the 
eye package specification mode 2, the field which contained both eyes, without dividing a field 
into each eye field is made into a processing-object field, is put in block, and bloodshot-eyes 
extraction processing can be performed. 

[0064] The independent specification mode 1 is the mode which surrounds the field containing 
th boundary region of one eye by the rectangle-like frame 13 with a mouse, a keyboard, etc. in 
which it was prepared by the image-processing section 1 6, specifies it, and makes the field in a 
frame 13 a processing-object field, as shown in drawing 1 1 (C). Also in this case, a frame 13 is 
good also as other configurations, such as not only the shape of a rectangle but elliptical. 
[0065] Moreover, the independent specification mode 2 is the mode in which specify the core of 
an eye, and the position of the frame formed so that the whole eye may be included as shown in 
drawing 1 1 (D), set up so that the frame 1 3 which contains one eye based on the ratio obtained 
statistically from the position of the frame to a core may be formed automatically, and the field 
in this frame 1 3 is specified as a processing-object field. 

[0066] The independent specification mode 3 is the mode in which set up so that the frame 13 of 
the default size containing the whole eye may be formed automatically, and the field in this frame 
1 3 is specified as a processing-object field, by specifying one one side with the core of an eye, 
or the periphery of an eye 15 times, as shown in drawing 1 1 (E). In addition, it can also consider 
as the mode in which set up so that the whole face may be surrounded by frames, such as the 
shape of a rectangle, and elliptical, etc. in this case and the frame of one eye or both eye area 
size may be automatically formed after specification according to the ratio of a face and an eye, 
and this field within the limit is specified as a processing-object field. Or it can also consider as 
the mode in which form automatically the frame which specifies the core of both eyes and 
includes both eyes, and this field within the limit is specified as a processing^object field. 
[0067] The independent specification mode 4 is the mode in which the field within the limit which 
surrounded in the handwritten way with a mouse, a keyboard, etc. in which it was prepared by 
the image-processing section 1 6, was crowded and formed the surrounding field of the eye 
containing an eye is specified as a processing-object field, as shown in drawing 1 1 (F). 
[0068] next — Step 102 — the six above-mentioned modes — the characteristic quantity of the 
processing-object field specified by any one mode is computed Here, the value of the color 
obtained from a hue, saturation, and lightness as an extraction element is chosen, and the 
characteristic quantity which can start the picture of a pupil portion collectively is chosen. 
[0069] Since it becomes so large that redness of an r value is strong when redness is expressed 
with an r value here, in the bloodshot-eyes section, it becomes a large next door, and becomes a 
minus value by the blue eye. Moreover, if lightness is expressed with a gray d value, since d value 
serves as size, a bright pixel will serve as smallness by the iris section of a large next door and 
the Brown system pupil in the catch light section and the pewter section. 

[0070] Specifically, when a red value (r) is made into characteristic quantity A and a gray value 
(d) is made into characteristic quantity B, it is alphaxB+(1 -alpha) x|A|. — It is a formula (1) 
(however, although alpha= 0.3 or more and 0.5 or less are experimentally obtained as a desirable 
value of alpha), it can also consider as other values When the value of the characteristic quantity 
C obtained is graph-ized as a position on the straight line which passes a horizontal axis along a 
pupil, it has a mountain-like wave for every field of the element (for example, a pewter portion, a 
pupil portion, a skin portion) which constitutes a picture. In addition, in the definition of the 
above-mentioned characteristic quantity, it is good also as d= (R+G+B)/3 and A= (R-d) by the 
color expression by RGB. 

[0071] For example, the graph of the characteristic quantity C computed along with the line of 
the longitudinal direction which passes along an outer canthus has three mountain-like waves 
corresponding to the field of two pewter portions and the field of a pupil portion in right and left 
of a pupil, as shown in drawing 1 0 . In addition, extraction of bloodshot eyes is raising the 
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bloodshot-eyes extractability ability of the pupil of a blue system more difficult than the Brown 
system by absolute-value-izing characteristic quantity A in the formula of the above-mentioned 
' characteristic quantity C. 
[0072] Moreover, although the graph of characteristic quantity A is indicated to drawing 10 (b) 
and the graph of characteristic quantity B is indicated to drawing 10 (c) as an example of 
another characteristic quantity, respectively, in drawin g 10 (b) and d raw ing 10 (c), a solid line 
shows the characteristic quantity of the bloodshot eyes to which a pupil is reflected red, the 
dotted line shows the valuable characteristic quantity to which a pupil is reflected golden, and 
the overlapping field serves as a solid line. With these graphs, since the reflected light of 
monetary value is strong, yellow understands in tint that lightness is high soon for it. 
[0073] In the following step 1 04, field division of the picture is carried out for every field in which 
characteristic quantity forms a mountain. 

[0074] A user specifies or processing by the program is performed so that the pixel (namely, 
pixel of the position used as a valley) of low characteristic quantity may be most divided as a 
field as the method of field division, for example, as shown in drawing 1 0 (b) and drawing 10 (c). 
In drawing 10 (b) and drawing 10 (c), the bloodshot-eyes field containing a catch light forms a 
mountain, and the iris section serves as a valley between a pewter portion or a skin portion, and 
it has become the boundary of field division. In addition, when blue system pupils are bloodshot 
eyes, the iris section serves as a boundary of field division on the boundary of the blue iris 
section and the pupil section by above-mentioned |A|. 

[0075] Moreover, as an option, as shown in drawing 12 (B), the characteristic quantity D which 
has the mountain configuration where it corresponded every three fields of the portion of the 
pewter of both sides and a central pupil portion can be chosen, and number allotment processing 
can divide a field. 

[0076] This number allotment processing is processing which assigns the number of the pixel 
which has the biggest characteristic quantity in the reference area which makes the referenc 
area 24 which consists of nine pixels of three line x3 train which makes a central pixel the view 
pixel 21 a number allotment processing field, and consists of nine pixels to the view pixel 21, as 
shown in drawing 12 (A). 

[0077] As one example, the characteristic quantity D of drawing 12 (B) is chosen, and the field 
expanded partially is explained for explanation. As shown in drawing 13 (A), a total of the pixel 
line of three lines, the pixel line of N lines which is a pixel corresponding to the portions of the 
1st mountain configuration of the characteristic quantity D of drawing 12 (B) and the 2nd 
mountain configuration, the pixel train of N-1 line on it, and the lower pixel train of N+1 line, is 
shown in drawing 13 (B) and drawing 13 (C) n train every, respectively, in addition, the coordinate 
of each attention pixel — ** (however (XN, Ym), m one or more natural numbers) — it describes 

[0078] As shown in drawing 13 (B), when even eye eye one train - 3 train is made into the 
reference area 24, it first judges whether the characteristic quantity D of the attention pixel 21 
and the becoming pixel (XN, Y2) is the largest in the reference area 24. In this case, since the 
characteristic quantity of the pixel (XN, Y3) of **** is larger than the characteristic quantity of 
the attention pixel 21 and the becoming pixel (XN, Y2) as shown in drawing 1 3 (A), a number is 
not given to the attention pixel 21 and the becoming pixel (XN, Y2), but it judges whether 
characteristic quantity is large in reference area about the attention pixel of the next reference 
area. 

[0079] in addition, in this example, it shall process so that an attention pixel is alike and may 
move one [ at a time ] in the direction of arrow I in accordance with N train Therefore, as for the 
next reference area, reference area will move like eye eye three trains - 5 train and — in eye 
eye two trains - 4 train and its next reference area. 

[0080] As shown in drawing 13 (C), when even eye 3-5 train is made into the reference area 24, 
since the characteristic quantity of the attention pixel 21 and the becoming pixel (XN, Y4) 
corresponds to the peak of the mountain configuration exactly shown in drawing 1 3 (A), it 
becomes the largest. Therefore, "1" is given as a new allotment number and the size of 
characteristic quantity is judg d about the attention pixel of the next reference area (namely, 
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eye eye four trains - 6 train). 

[0081] Since characteristic quantity is smaller than the last attention pixel, as for all the 
•attentipn pixels of the reference area of up to eye eight trains make the pixel corresponding to a 
trough into an attention pixel from the reference area of eye ey four trains - 6 train - 10 train, 
"1" will be given altogether. 

[0082] Since all the reference area of up to eye 1 3 trains make the pixel in front of [ of the pixel 
corresponding to next Yamabe ] one into an attention pixel from the reference area of up to eye 
7 which make the following one pixel an attention pixel trains - 9 train of the pixel corresponding 
to the aforementioned trough - 1 5 train has characteristic quantity larger than the last attention 
pixel, a number is not given'altogether. "2" is given even for all the attention pixels of the 
reference area which makes the pixel corresponding to the following trough an attention pixel 
from the reference area of up to eye 14 trains make the pixel corresponding to next Yamabe into 
an attention pixel - 1 6 train as a new allotment number, by this repeat As shown in drawing 13 
(D), in allotment processing of a single-tier eye, the new allotment number corresponding to each 
mountain will be given partially. 

[0083] Therefore, since characteristic quantity in reference area including comparison with th 
number already assigned by number allotment processing of the Nth line will be measured when 
the following line, for example, the N+1st line, is made into an attention pixel, By performing 
number allotment processing repeatedly, the number to which the pixel which constitutes each 
mountain configuration was altogether given corresponding to each mountain configuration will be 
given, and, finally a number will be given to all pixels. Therefore, two or more fields divided by th 
number which corresponded for every mountain configuration of characteristic quantity will b 
obtained. 

[0084] In addition, a pixel with larger characteristic quantity (Xn, Ym+1) than the characteristic 
quantity of an attention pixel (Xn, Ym) exists in reference area. When the number is not given to 
this pixel, the position of an attention pixel (Xn, Ym) is memorized as a coordinate, the pixel (Xn, 
Ym+1) of the aforementioned **** — a new attention pixel — carrying out — reference area — 
determining — this — it judges whether it has the characteristic quantity in the newly 
determined reference area with the new biggest attention pixel (Xn, Ym+1 ) 

[0085] the above, if the pixel which has bigger characteristic quantity than a new attention pix I 
(Xn, Ym+1) exists in the newly determined reference area Furthermore, the position of a new 
attention pixel (Xn, Ym+1) is memorized as a coordinate, the above — you may process the pixel 
(Xn+i, Ym+j) (however, i and j integer) which has bigger characteristic quantity than a new 
attention pixel (Xn, Ym+1) so that the processing same as a new attention pixel may be repeated 

[0086] In this case, if it memorizes when a number cannot be given about the pixel which 
measured characteristic quantity once, although only the pixel of the same line does not 
necessarily turn into an attention pixel, and a number is given to a pixel with the highest 
characteristic quantity in the field since the number will be given to all the memorized pixels as 
shown in drawing 14 — repeatedly — repeating — ** — compared with the case where 
measure characteristic quantity and a number is given, number allotment processing can be 
performed at a quick speed By such number allotment processing, as shown in drawing 6 , the 
area corresponding to the part of an eye by which field division was carried out for every field is 
obtained mostly. 

[0087] At Step 106, it checks [ field / which was divided at Step 104 ] about each of a 
configuration, an arrangement relation (position) with other fields, the rate of surface ratio, 
concentration, and an average tint, respectively, and what has the feature of a pupil portion most 
is chosen as a bloodshot-eyes field. In addition, when two or more fields are chosen as a 
bloodshot-eyes field in the picture of on eye, it evaluates about each of a configuration, an 
arrangement relation (position) with other fields, the rate of surface ratio, concentration, and an 
average tint, and the field where evaluation is the highest is chosen as a bloodshot-eyes field. 
[0088] As the method of evaluation, for every division field, it asks for the 1st mark to which 
mark become high, and there is the m thod of making what has the f ature of a pupil portion 
most, i.e., a bloodshot-eyes field, what has the highest mark, for example, so that circularity is 
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large. Moreover, the distance between the position of the center of gravity and the center 
position of the appointed field is computed, for every division field, it asks for the 2nd mark from 
• whichTpark serve as size, so that distance is short, and there is the method of making what has 
the feature of a pupil portion most, i.e., a bloodshot-eyes field, what has the highest mark. 
[0089] Furthermore, it asks for the 3rd mark to which mark become small, and there is the 
method of making what has the feature of a pupil portion most, i.e., a bloodshot-eyes field, what 
has the highest mark, so that it asks for the ratio of the area of a division field, and the area of 
the appointed field and the obtained ratio separates from it for every division field from 
predetermined ranges, such as the range of the ratio of the area of a pupil and the area of the 
appointed field for 

[0090] Moreover, the average or more in any one of a hue, saturation, and lightness, Any one or 
more of maximum, the minimum value, contrast, and histogram configurations are used. From 
comparison with the statistical color tone poor field information measured beforehand, what has 
the feature near the feature of a color tone poor field asks for the 4th mark to which mark 
become high, and has the method of making what has the feature of a pupil portion most, i.e., a 
bloodshot-eyes field, what has the highest mark. 

[0091] Furthermore, it asks for the 5th mark to which mark become small, and there is the 
method of making what has the feature of a pupil portion most, i.e., a bloodshot-eyes field, what 
has the highest mark, so that it asks according to the center position of a pupil specified 
beforehand, and the interval of both eyes and separates from the center of a pupil. If a pupil 
portion separates from a pupil with the peak as shown in drawing 15 (B) showing the mark on the 
dashed line shown in d rawing 1 5 (A), the 5th mark will be set up so that mark may become low. 
[0092] Although at least one of these five mark may be chosen and a bloodshot-eyes field may 
be distinguished based on these mark, it is good more preferably to judge the field of a high order 
L (1 or more [ However, L ]) individual by the number of the average mark or weighted averag 
mark or more in two of the five aforementioned mark to be a color tone poor field. 
[0093] For example, as shown in drawing 16 , when being divided into six area (division field), as 
shown in drawing 16 (A) The 1st mark One A4 area, two A6 area, three A2 area, Four A3 area, 
five A1 area, and area 6 are A5 points, and, as for area 1 , as for B5 point, two B4 area, and ar a 
3, the 2nd mark presuppose that it is B6 point B-2 point, four B3 area, five B1 area, and area 6. 
However, A1>A2>A3>A4>A5>A6 — (1) B1>B-2>B3>B4>B5>B6 — It is (2). 
[0094] Therefore, if the average mark of the 1 st mark and the 2nd mark is taken out for every 
field, as shown in drawing 1 6 (B) Area 1 (A4+B5) / two points, and area 2 (A6+B4) / two points, 
The area 3 of (A1+B1) / two points, and area 6 becoming (A5+B6) / two points in (A3+B3) / two 
points, and area 5, and area 5 having [ (A2+B-2) / two points, and area 4 ] the highest mark from 
the formula of the above (1) and the formula of (2) is clear. 

[0095] In addition, what has still higher mark is high by taking the weighted average which gave 
heavy weight to the high order of mark, and since a low thing becomes low, what a mark 
difference spreads and has the feature of a pupil portion most is clearly distinguishable. 
[0096] In the pixel of a bloodshot-eyes field, based on the pixel of the minimum lightness, at Step 
108, the lightness of all pixels is amended to the pixel of the bloodshot-eyes field chosen as 
mentioned above so that it may be the same as the lightness of the pixel of the minimum 
lightness or may approach. For example, when lightness of the pixel of the bloodshot-eyes field 
which serves as dmin and a candidate for amendment in the lightness of the pixel of the 
minimum lightness in the pixel of a bloodshot-eyes field is set to x, computing lightness x after 
amendment of the pixel of the bloodshot-eyes field used as the candidate for amendment by the 
following formulas (2) is mentioned. 
[0097] 

x -x-(x-dmin) xa — Formula (2) 

(Since the picture after correction will be made in addition with a natural atmosphere if the value 
of a is set to 1<=a<=1.3, it is desirable.) The pupil section which became bloodshot eyes as a 
result serves as a picture to which it applies in the center from the circumference and lightness 
falls gradually after correction. 

[0098] Along with the line which passes along an outer canthus as an example of correction, the 
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lightness before correction is shown in drawing 7 (a), and the lightness after correction is shown 
» n drawing 7 (b). 

* [0099} According to the saturation of the pixel of the minimum saturation, it amends about 
saturation as well as the correction method of the above-mentioned lightness. Of course, as long 
as it is finished in a natural atmosphere, only saturation may carry out amendment composition 
only of the lightness also as amendment composition. In addition, it is also possible to consid r 
as the special tint which could set up the amount of amendments of characteristic quantity 
b forehand according to liking of a user, and was doubled with liking of a user in this case. 
[0100] Or a gradation pattern is formed in a radial toward a periphery as other correction 
technique from the center of the corrected bloodshot-eyes field, and it attaches by the color 
which had the gradation pattern specified that concentration becomes thin toward a periphery 
from a center. Here, the maximum concentration value detected from the pupil portion of other 
fields which do not serve as a specified color on bloodshot eyes, the minimum concentration 
value and the aforementioned maximum concentration value, the maximum concentration value 
adjusted from the minimum concentration value, the minimum concentration value, the maximum 
concentration value, the minimum concentration value which were beforehand defined by the 
user, etc. can be chosen. In addition, since the art which gives a gradation pattern is well-known 
technology, detailed explanation is omitted. 

[0101] In case dmin of the above-mentioned formula (2), the maximum of the concentration for 
gradation pattern controls, and the minimum value are determined, you may change either of the 
whole picture as a comparison field in the appointed field of an eye, and a face field in a 
bloodshot-eyes field. 

[0102] At Step 1 10, a partial high brightness field, i.e., a highlight field, is formed in the corrected 
bloodshot-eyes field, and let this be a catch light. The position of a catch light is made into the 
maximum lightness position of the bloodshot-eyes field before correction, and is performed by 
forming the luminescent spot of a radial based on the maximum lightness position. 
[0103] For example, when lightness of the pixel of the position which has dmin and the 
bloodshot-eyes field which serves as k and a candidate for amendment in the adjustment factor 
of lightness in the lightness of the pixel of the minimum lightness in the pixel of a bloodshot-eyes 
field is set to y (i, j), computing lightness y' (i, j) of the pixel of the catch light position in a 
bloodshot-eyes field by the following formulas (3) is mentioned. 
[0104] 

y'(i, j) =dmin+k(i, j) x {y(i, j)-dmin} — Formula (3) 

However, i andj show the position in a catch light, and from a center, the lightness of the pixel 
which constitutes a catch light sets up the adjustment factor k of lightness, since it becomes low 
gradually at a radial, for example, as shown in the table shown in drawing 8 , and it changes the 
adjustment factor k of lightness (i, j) according to the position in a catch light (i, j). 
[0105] In addition, it can consider as the pupil picture of a much more natural atmosphere by 
making it correspond to the picture size of the bloodshot-eyes field to correct, and setting up 
the size of a catch light, and the adjustment factor of lightness. 

[0106] Moreover, although it is made to change the lightness of each pixel according to to which 
position of a catch light a pixel corresponds in order to form a catch light portion, it can also 
constitute from this operation gestalt so that a catch light pattern may be formed beforehand 
and it may stick on a catch light position. It can set up so that enlarging or contracting of a size 
can be freed also in this case, and it can consider as the pupil picture of a much more natural 
atmosphere by making it correspond to the picture size of the bloodshot-eyes field to correct, 
and changing the size of a catch light. Of course, it can do with the pupil picture of a much mor 
natural atmosphere by enabling it to set up lightness freely similarly about lightness. 
[0107] The graph of lightness which met the line of the longitudinal direction which passes along 
the outer canthus of the picture which performed bloodshot-eyes correction to drawing 9 , and 
formed the catch light pattern in it is shown. 

[0108] In addition, although processing from Step 102 to Step 106 shall be performed once about 
the same appointed field with this operation gestalt, it can also consider as a setup which 
repeats processing from Step 102 to Step 106 two or more times, and performs it, and 
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extraction of a bloodshot-eyes field can be extracted with a much more sufficient precision in 
this case. 

£0109] Jn addition, this invention can connect not only the composition described above but an 
adjoining division field, and can also apply bloodshot-eyes evaluation. For example, when 2 *###s 
of original bloodshot-eyes portions are carried out, evaluation of circularity increases by 
connecting the field wher a bloodshot-eyes portion is contained, and recognizing as one field. 
Consequently, when the evaluating point of the connected field exceeds the evaluating point in 
an individual division field, the connected field is judged to be a bloodshot-eyes field. 
[0110] In addition, since each processing of the above-mentioned bloodshot-eyes extraction, 
bloodshot-eyes field correction, catch light addition, etc. is an execute permission independently, 
it can also perform bloodshot-eyes correction processing with the combination for which other 
t chnique or manual processing was substituted about each of each processing. 
[01 1 1] Moreover, you may perform amendment processing which carries out enlarging or 
contracting of the normal pupil to the extracted bloodshot-eyes field, and sticks it on it. In this 
case, after sticking an eye, it is good to modify and to make it suit sensibility of the whole. 
[0112] 

[Effect of the Invention] As explained above, according to invention of a claim 1 to the claim 3, 
the effect that only the field which divides a field correctly and has the need for correction can 
be chosen as a correction object domain no matter it may be what picture is attained. 
[01 13] Moreover, according to invention of a claim 4 and a claim 5, the effect that only a pupil 
field can be chosen correctly is attained. 

[01 14] Furthermore, according to invention of a claim 6 to the claim 20, the effect that the pupil 
field which is a correction object domain is correctly correctable is attained. 
[01 1 5] Moreover, according to invention of a claim 21 , the effect that a natural atmosphere can 
be made to the corrected picture is attained. 

[01 16] Moreover, according to invention of a claim 22, the effect that bloodshot-eyes 
amendment processing can be performed with a sufficient precision is attained. 
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* NOTICES * 

'Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the outline block diagram of the digital language laboratory system concerning 
the gestalt of operation of this invention. 

[Drawing 2] It is the general-view view of digital language laboratory system. 
[Drawing 3] It is the control-block view of the image-processing section. 

[D rawin g 4] It is the flow view showing the flow of the bloodshot-eyes correction processing in 
the bloodshot-eyes processing sections 220 and 222. 

[Drawing 5] It is the graph of the characteristic quantity C at the time of computing along with 
the line of the longitudinal direction which passes along an outer canthus. 
[Drawing 6] It is explanatory drawing at the time of dividing for every mountain based on 
characteristic quantity C. 

[Drawing 7] (a) is the graph of lightness which met the line of the longitudinal direction which 
passes along an outer canthus, and (b) is a graph which shows the state where the lightness of 
the bloodshot-eyes field in (a) was corrected, based on the formula (2) set to a= 1 .3. 
[Drawin g 8] It is drawing showing the relation between the position of the pixel in a catch light, 
and the adjustment factor of lightness. 

[Drawing 9] It is the graph of lightness which met the line of the longitudinal direction which 
passes along the outer canthus of the picture which performed bloodshot-eyes correction and 
formed the catch light pattern. 

[Drawing 10] (a) is the transverse-plane schematic diagram of an eye, (b) is the graph of the 
characteristic quantity A computed along with the line of the longitudinal direction which passes 
along an outer canthus, and (c) is the graph of the characteristic quantity B computed along with 
the line of the longitudinal direction which passes along an outer canthus. 
[Drawing 11] It is explanatory drawing showing the example of the specification method of the 
processing-object field by the operator. 

[Drawing 12 ] It is explanatory drawing explaining the method of number allotment processing, and 
drawing 12 (A) shows reference area and drawing 12 (B) shows the graph of the selected 
characteristic quantity D. 

[Drawin g 13 ] Drawing 13 (A) is a graph which shows a part of characteristic quantity D, and 
drawing 13 (B) - drayying 1 3 (D) are explanatory drawings showing a number allotment procedure. 

[Drawing 14] It is explanatory drawing explaining the option of number allotment processing. 

[Drawing 15] Drawing 15 (A) shows a processing-object field, and drawing 15 (B) is a graph which 

shows the mark of a field in alignment with the visual axis of drawing 1 5 (A). 

[Drawing 16 ] Drawing 16 (A) is explanatory drawing having shown the 1st mark given to each of 

six division fields, and the 2nd mark. Drawing 16 (B) is explanatory drawing having shown each 

number of the average mark for every six division fields. 

[Description of Notations] 

1 0 Digital Language Laboratory System 

14 Line CCD Scanner 

1 6 Image-Processing Section 
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66 Light Source Section 

68 Photographic Film 

200 Data-Processing Section 

202 Log Converter 

204 Press Can Memory 

206 Fine Scan Memory 

208 Image-Data-Processing Section 

212 Press Can Processing Section 

214 Image-Data-Processing Section 

218 Fine Scanning-and-Processing Section 

220 Bloodshot-Eyes Processing Section 

224 Conditioning Section 

234 Lens Property Data Feed Zone 



[Translation done.] 
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